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Assessment of Student Attitudes Toward Learning Environments- 

U.S DEPARTMENT OF HEALTH. 

EDUCATION* WELFARE 
^ NATIONALINSTITUTEOF 

lu%o?iTjFT^^^^^''-^^''^^- Mark W. Blair and Keith M. Kershner 

? Research for Better Schools, !nc* 

t£iic^^^^^ 1700 Market Street, Suite 1700 

f u^cSJK^^^^ Phi ladelphia, Pennsylvania 19103 

CD ' Research for Better Schools, Inc. (RBS) has developed an experience 

O 

^ f based career education program designed to provide secondary school 

students with cognitive skills, career experiences, and personal perspec- 
\ 1 tives to aid In the selection and pursuit of adult life goals. To 
^ . meet these objectives, the program utilizes self-paced learning resources, 

direct participation at business, agency, and other community resource 
sites, individualized classroom experiences , and instructional guidance 
activities (Haguire and Connolly, 1972). The RBS Career Education Pro- 
gram -is-'Currentlyj in its third year of operation. 

The obiectlve of the present study was the development and vallda- 
tlon of an instrument to assess student attitudes toward traSltfonal and 
fTontraditlonal learning environments. The development of the Instrument 
was undertaken in response to a program need for feedback from student 
participants regarding the success of the implementation of the RBS Career 
Education Program. Student attitude toward the program was viewed as one 
index of such success. Since much of the student participation In the RBS 
js^ Career Education Program occurs outside of traditional school settings, an 

instrument which was capable of assessing student attitudes toward a 

i'^ _^ 

* ^ 

*Based on a paper presented at the 1975 Annual Meeting of the American 
Educational Research Association held in Washington, D.C., April, 1975. 
Hark W. Blair is an Evaluation Specialist and K^lth M. Kershner is 
, . D^t.rectoP -of Evaluation for the RBS Career Ed»^cat\on Program. 
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variety of nontrad i tional learning environments was needed. Since com- 
parisons were to be made with students in traditional schools the 
instrument would also have to be capable of assessing student attitudes 
toward traditional learning environments. A review of Buros (1972) and 
Shaw and Wright (1967) indicated that such an instrument was not available* 

The development of instruments to assess attitudes has been one of 
the most problematic areas within the field of psychometrics. The main 
problems which have complicated the study of specific attitudes have 
been the lack of an accurate definition of the word "attitude** and the 
inability to consistently isolate attitudes as discrete behavioral 
attributes. 

Several definitions of "attitude" are extant. Among them are those 
presented below. Sherif and Sherif (1956) viewed attitudes as relatively 
stable, enduring, learned and having social referents. Osgood, Suci, 
and Tannenbaum (1957) and Anderson and Fishbein (I965) asserted that 
attitudes are implicit responses which produce motives; these Implicit 
responses are based on evaluative and affective responses. Krech, Crutch- 
field, and Ballachey (1962) posited that attitudes vary in quality and 
intensity on a continuum that ranges from positive through neutral to neg- 
ative and that different attitudes are related to one another to the 
extent that they have the same referents. Shaw and Wright (1967) synthe- 
sized these defincions and viewed attitudes as relatively enduring systems 
of covert, implicit affective and evaluative reactions which are based 
upon and reflect learned evaluative concepts or beliefs about characteristics 
of social objects or classes of social objects. The definition offered by • 
Shaw and Wright is preferred by the current authors. 



Attitudinal measurement and investigation have rested primarily on 
a mathematical model of linearity and unldimenslonal Ity (Shaw and Wright, 
1967). This mathematical model is reflected in the logical measurement 
techniques predominantly used in the assessment of attitude: the Thurs- 
tone, Likert, and Guttman approaches. A brief description of each is 
given. 

The Thurstone method uses a researcher-built pool of items which 
Is submitted to a group of objective judges whose purpose is to evaluate 
each item of the pool as to the degree of positive or negative feelings 
the statement contains (Green, 195^). Each item is evaluated on a scale 
of eleven points. Items are' assigned scale values and then presented to 
the subject pool for individual responses of "agree" or "disagree" to 
each Item. Subjects who agree to the positive statements and disagree 
with ri^ative statements are scored as high positive attitude individuals 
and vice versa. 

Likert's (1932) modification of the Thurstone technique has been 
found to be equally efficient and effective in obtaining similar 
results to the Thurstone scale (Shaw and WHght, 1967). Items from the 
item pool are presented directly to the subject group rather than to a 
team of judges. Response options are usually presented as a five-point 
scale with options ranging from Strongly Disagree to Strongly Agree. 
Weights of 1 through 5 are respectively assigned to each response. The 
total score is the summation of all weights. 

Guttman's (19'»A, Guttman and Suchman, 19'»7) technique rests on the 
assumption of homogeneity of attitude within the individual. Following 
this assumption, this scale employs its unldimenslonal 1 ty In such a 
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way that, should an individual respond negatively to one question, all 
succeeding negative responses in this test can be predicted consistently. 
There is no attempt In the Guttman procedures to establish either equal 
intervals or a zero point for responses. 

Likert's scaling technique was selected for the construction of 
scales of student attitudes toward learning environments since the 
developed instrument would rest neither on the ratings of judges nor on 
techniques which have been criticized for the lack of unequal intervals 
in the scales. The Likert approach has the added Advantage of resultant 
summated scores which are an efficient means of securing information on 
Individual and group attitudes and which require no extensive written 
responses. An instrument consisting of Likert scales can also be adminis- 
tered and scored by a small number of staff personnel. 

METHOD, DATA SOURCE, AND RESULTS 

A review of the development of the Assessment of Student Attitudes 
Toward Learning Environments Scale (ASA) is presented. Three separate 
versions of the ASA evolved during the developmental effort; each sub- 
sequent version was based on the analysis of the preceding version. 
Figure 1 highlights the development efforts. 



Insert Figure 1 



ASA; Version I 

A pilot pool of 95 items was constructed. Each item was in the form 
of a hypothetical student quotation. Fifty-nine (59) of the items were 
presented as positive student statements and 3.6 were presented as negative 
student statements. The items were constructed to yield six subscales of 
the ASA. The subscales were Attitude Toward the Educational Process, 
Attitude Toward Program Curriculum, Attitude Toward Program Resources, 
Attitude Toward Program Counseling, Attitude Toward Social Environment, 
and Attitude Toward Learning. 

Version I of the ASA was administered to 30 twelfth grade students 
participating in the Sutitner 1973 Career Education Program. To ens.ure 
sufficient variability of scores, items were presented on a 10 point 
response continuum ranging from Strongly Disagree to Strongly Agree. An^ , . 
Jntercorrelation matrix was constructed with subscale and total scores, 
items were rejected if the i tem-subscale score correlation was less than 
.kS or the item-total score correlation was less than .30. Forty-two CjZ) 
items were deleted for bailing to meet these criteria. The category Social 
Environment was eliminated due to the paucity of remaining items. This 
resulted in the deletion of two additional items. The remaining 51 items 
were resubmitted for analysis. The calculated reliability (alpha coefficient 
of .96) indicated a high degree of internal consi'stency for the instrument. 

Tea;her ratings of students on the scales were used as a validity 
criterion. The developers were aware of the weai<nesses of the use of 
teacher ratings but had no other checi< which could be used. They also 
felt that the small number of students and teachers involved would assure 
greater dependability than is usually attributed to teacher ratings. A 



second step was taken to increase the dependability of the teacher 
ratings; teacher ratings and student scores wore dichotomized to permit 
a comparison between the directionality of the two. The percent agree- 
ment between directionality of teacher, rati ngs and student scores was .,?8 
and indicated a high degree of validity for the ASA. 



ASA: Version I I 

The ASA: Version II contained the 51 items remaining from Version I. 
Examination of the items led to the deletion of one item due to wording 
difficulties. The revised ASA thus consisted of 50 items; 25 of these 
were in the form of positive student statements and 25 were in the form of 
of negative student stat-.irents. Order of presentation was rerandomized . 
The items yielded five subscales: Attitude Toward Education in General, 
Attitude Toward School Curriculum, Attitude Toward School Resources, 
Attitude Toward School Counseling, and Attitude Toward Learning. 

Version II of the ASA was administered in the Fall of 1973 to 258 
tenth, eleventh, and the twelfth grade students who formed the experimental 
and control groups of the FY ]S7k RBS Career Education Program. The for- 
mat for each response was a 5 point Llkert scale. These responses were 
submitted to an item analysis. An, addi tlonal 10 items were deleted due 
to item to subscale score or item to test score correlations less than 
.20 and the data were reanalyzed. Subscale to total score correlations 
were as follows: Attitude Toward Education, .96; Attitude Toward School 
Curriculum, .9'*; Attitude Toward School Resources, .77; Attitude Toward 
School Counseling, .89; and Attitude Toward Learning, .36. The split 
half reliability of the instrument was .86. On the basis of these results. 
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the Attitude Toward Learning Scale was deleted from the Instrument, 
and the item order was rerandomized . 

ASA: Version 1 1 I 

Version III of the ASA consisted of the 2? Items retained from 
Version ll-i-^U of the Items were in the form of positive student state- 
ments and 1^ were in the form of negative student statements. The 
items yielded four subscales: Attitude Toward Education in General, 
Attitude Toward School Curriculum, Attitude Toward School Resources, 
and Attitude Toward School Counseling. 

Version II I of the ASA was administered in Spring 197^ to 205 
experimental and control students of the RBS Career Education Program. 
These responses were also submitted to an Item analysis. One additional 
Item was deleted due to low Item to subscale score correlation and sub- 
scale to total score correlations were calculated. Subscale to total 
score correlations were as follows: Attitude Toward Education, .99; 
Attitude Toward School Curriculum, .97; Attitude Toward School Resources, 
.63; and Attitude Toward School Counseling, .96. The split half reliabll 
ity of the instrument was .90. Table 1 presents subscale to total 
correlations and the split half reliability of Version 11 and Version III 
of the ASA, 
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Table 2 presents I tern to subscale and item to overall mean 
correlations for Version III of the ASA. The final form of Version III 
is included in the reference section of this paper. 



Insert Table 2 



Use of Version II and Version 1 1 1 of the ASA on a pretest-pos ttest 
basis with an experimental and control group of the RBS Career Education 
Program allowed the instrument's sensitivity for assessing change in 
attitudes to be checked. Analysis of variance on the pretest scores 
indicated no differences between the groups. Posttest data for the two 
groups were submitted to an analysis of covar lance with the pretest score 
the covariate. The alpha level used in the project was .10. Three of the 
four subscales and the overall scale indicated significant differences 
between the tv/o groups* changes in attitQdes toward learning environments. 
These results indicate that the ASA is sensitive for detecting differential 
changes in attitude. Table 3 presents the results of the analyses of 
covar lance. 



Insert Table 3 



SUMMARY AND CONCLUSIONS 

Research for Better Schools (RBS) began the implementation of an 
experience based career education program in September 1972. Student 
attitude toward this innovative educational program was viewed as one 
index of successful implementation. No instrument was avai lable which 



would assess student attitudes toward learning environments which ex- 
tended beyond traditional school settings. 

This paper has reviewed the development to date of the Assessment of 
Student Attitudes Toward Learning Environments (ASA). The ASA 
evolved through three versions to its current form of 26 student statements 
presented in a Likert format. The 26 items yield four subscales and an 
overall score. The four subtests are Attitude Toward Education in 
General, Attitude Toward School Curriculum, Att i tude Toward School Resources, 
and Attitude Toward School Counseling. Each Version had reliability 
coefficients which indicated a high degree of internal consistency for the 
ASA. Teacher ratings were used as a validity criterion for Version I 
and indicated that the instrument has h.?gh validity. Use of Version II 
and Version III on a pretest-posttest basis indicated that the ASA is 
sensitive to detecting differential group changes in attitude. 

The ASA is still in a developmental form. Additional validity studies 
are planned and need to be conducted. Consideration should be given to 
the reconstruction of deleted scales and to further development of current 
scales. 

The importance of this study is that a reliable, sensitive, and, as 
far is known, valid instrument has been developed for measuring student 
attitudes toward educational programs which extend beyond traditional 
school settings. While further development is indicated for the ASA, it can 
be used in its present form for measuring secondary school student attitudes 
toward educational programs in both traditional and innovative settings. 




Table 1 

ASA Subscale to Overall Mean Correlations 



Subscale 


Version 11 


Vers ion 1 1 1 


L Attitude Toward 

Education in General 


• 96 


.99 


2. Attitude Toward 

School Curriculum 


• 9^ 


.97 


3* Atti tude Toward 
School Resources 


• 77 


.63 


Attitude Toward 
School Counseling 


•89 


.96 


5. Altitude Tow<Trd 
Lcarninq 


.36 




Spilt half rel iabi lity 
(Spearmnn-Brown) 


• 86 


.90 



ERIC 



11 

11 



Table 2 
ASA: Version III 
Item Correlations 



Subscale 



Attitude 
Toward 
Education 
In General 



I tern 



li 

15 
16 
18 
19 
21 
26 



tern to Subscale 
Correlat ion 



.71 
M 

.58 
.61 
.60 
.60 



I tern to Overal 1 
Mean Correlation 



.61 
.35 
.33 
M 
.56 
.57 
.59 



Atti tude 
Toward 
School 
■Curriculum 



Attitude 
Towa rd 
School 
Resources 



Atti tude 
Towa rd 
School 
Counsel tng 



1 

7 
8 

17 
20 



2 
3 
6 
10 
11 
13 
14 
22 
25 



5 
9 
12 

23 
2i» 



.70 

.72 
.53 
.71 



.61 
.55 
.57 

.'»9 
.57 
.67 
.67 
.70 



.66 
.63 
.66 
.55 
.73 



.61 
.A6 
.50 
.36 
.52 



.51 
.'»3 

M 

.53 
.52 

.55 
.62 



.57 

.60 
.33 
.59 




TABLE 3 

Analyses of Covariance on Comparative ASA Gains in Raw Scores 



Attitude Towtfd Educttion in General 



Group 


n « 


Pretttt Mean 


PotttMtMMn 


Adjutttd Mmh 


M««ft 
Diff«ftnc« 


E2 


32 


4356 


354.5 


353 7 




C 


56 


337.2 


3357 


337.6 


15.1 



Sourc* 


SS 


df 


MS 


F 


Bitwten 


4611.2247 


1 


4611 2247 


0 8322 


Wtthtn 


470958 5300 


85 


5540 6887 




Tot«l 


475569.7347 


86 


P<.3643 



tl. Attitude Toward School Curriculum 



Qrcup 


n 


Primt Mun 


Pottmt Moan 


Adjumd Mun 


Mf*n " 
Difftrifict 


E2 


32 


345 0 


3604 


375 6 




C 


56 


372.1 


351.8 


345 6 


XO 



Sourc* 


SS 


df 


MS 


B«tw«cn 


17835 5841 


1 


17835 5841 


Within 


511322 UOOO 


85 


6015 5530 


Tot*l 


529157.5841 


86 





2 9640 



P< 0888 



III. Attitude Towerd School Rasources 



Group 


n 


Prttett Mc«n 


Potttttt Mean 


Adjusted Maan 


Mem 
DiHertnca 


E2 


32 


319 8 


380 3 


3319 




C 


56 


337.5 


324 9 


321.3 


626 



IV. Attitude Touard School Countellnfl 



Group 


n 


Pretatt Maan 


Pomitt Maan 


AdiutttdMaan 


Maan 
Dlff*rin«« 


E2 




282.9 


3400 


342.8 




C 


56 


294.6 


307.6 


305.1 


37.7 



Sourca 


SS 


df 


MS 


F 


8ttwaan 


78166 6852 


I 


78166 6852 


19 8107 


Within 


335383 2900 


85 


3945 6858 




Total 


4135499732 


86 




p<.0001 








1 




Sourc* 


SS 


df 


MS 


F 


8a twain 


23361.4982 


1 


23361.4982 


3 3917 


Within 


710772.5400 


85 


8362 0299 




Toul 


734134 0382 


86 




p<.oeoi 



V. OmuM AiMtoidi Towvd LeenwnQ Cnviccoment 
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Oroup 


ft 


l^^atval Maan 


Poma«tMa«n 


Ad|ut:adMa«n 


Maan 
Diffarance 


€3 


32 


32&2 


381.8 


393.2 




C 


S6 


3M.fl 


330.3 




34.4 
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Souro* 


SS 


df 


MS 


F 




24086 0750 


1 


240860/60 


5.7670 


Within 


364948.2200 


66 


4176 6615 




Total 


379034.2960 


86 




M<.0186 
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ASSESSMENT OF STUDENT ATTITUDES 
INSTRUCTIONS 

In developing school programs and planning for the future It 

is important to know-what students think about various aspects of 
their education. This questionnaire has been designed to give you 
an opportunity to express your opinions about some general educational 
issues based on your experience in school over the past year. 

This is not a test and there are no right or wrong answers. 
Your honest opini.ons will be appreciated and helpful In improving the 
school program. All answers will be kept confidential. If you have 
any questions, raise your hand for assistance. 

Please read each statement carefully and think about your exper- 
iences in school over the past year in terms of what the statement 
says. For each statement circle the number on the scale which shows 
the extent of your agreement or disagreement with the statement. If 
you circle a higher number {h or 5)> it means that you agree with what 
the statement says. If you circle a. lower number (1 or 2) , it means 
that you disagree. The more you agree, the higher the number you 
should circle. The more you disagree, the lower the number you 
should cirile. If you circle a number (3) at the middle of the scale, 
it means that you're not sure how much you agree or disagree. 



15 

15 
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K There is a great deal being taught at my school that !s useful 
for me as a person. 

Strongly ^..>, - Strongly 

-Disagree -Agree^ 

.^^ 2 ^ ^ 5, 

2. The teachers at my school do not seem to know enough about what 
they • re teach I ng . 

Strongly Strongly 
Disagree Agree 

iJ ? ? ^ 5^ 

3. The facilities at my school are old and out-dated. 

Strongl.y Strongly 
Disa'gree - : Agree 

V ^- 1 ^ 

I've learned a lot from my school program. 

Strongly Strongly 
Disagree Agree 

yL ? ? ^ 5, 

5. My school counseling program has shown me some Interesting things 
about different careers. 

Strongly Strongly 
Disagree Agree 

? ^ ^ ^ 

6. My school has a lot of books and equipment that I can use to 
help myself learn. 

Strongly Strongly 
Disagree Agree 



J 2 l_ 



7. The experiences I get in my school learning sessions have not 
really helped me to learn. 

Strongly Strongly 
Disagree Agree 

|J ? ? 5 

ERIC 'ie 



8* Most of the courses In school are useful 



Strongly' 
Disagree 

. 1 



4- 



Strongly 
Agree 

— k 



9. There are very few people and places In my school that I can go to 
when I have a personal problem. 



Strongly 
Disagree 

. 1 



Strongly 
Agree 



10. rd say school was really worthwhile. 



Strongly 
Disagree 

, 1 



-Strongly 
Agree 



4- 
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My school does not have, very good equipment to help learning. 



Strongly 
Disagree 

. 1 



Strongly 
Agree 



+ 



12. The counseling program at my school has been good for me< 



Strongly 
Disagree 

. 1 



Strongly 
Agree 



4- 



13. I used many new materials to help me In my school work. 



Strongly 
Disagree 

l1 



Strongly 
Agree 



\h. My school uses a variety of ways to help us learn - not just 
a classroom and teacher. 



Strongly 
Disagree 

. 1 



Strongly 
Agree 
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15. Some of the ideas I've gotten in school* have helped me get 
Interested In some new area* 

Strongly Strongly 
Disagree Agree 

I ? ^- ^ 



16. School has always been boring - \ can hardly wait until Mm 
out. 

Strongly Strongly 
Disagree " ^ Agree 

I ? ^ 5^ 

17. Education, even vocational education, doesn*t help with your 
job when you leave school. 

Strongly Strongly 
Disagree Agree 

I ? ^ ^ 

18. My parents are not very excited about the education 1 am 
gett ing . 

Strongly Strongly 
Disagree .„ Agree 



1 



4- 



19. My school program, in general, has not been very good. 

Strongly Strongly 
Disagree Agree 

g ? \ ^ 

20. Much of * what I learn in school I can use in a job. 

Strongly Strongly 
Disagree Agree 

I ? ^ 

21. I like school because I learn a lot of new things there. 

Strongly - „S.trong1y 

Disagree Agree^ 

J 1 ? ^ ^ 



ERIC 



18 

18 



22. The people who run my school probably do not enjoy what they're 
doing* 

Strongjy Strongly 
Disagree Agree 

1-! ? ? 5 

23* Not much of the advice I have gotten ?n my school has helped me 
decide on what I want for my future. 

Strongly Strongly 
Disagree Agree 

i-t ? ^ 5 5| 

2^. My school's counseling program isn't really helping me get 
ready for things I'll do after I graduate. 

Strongly Strongly 
Disagree Agree 

^^ ? ^ 5i 

25* The teachers I had In my school were not very interesting. 

Strongly Strongly 
pisagree Agree 

|J 2 ? k 1^ 

26. School, in general, Is not doing enough to prepare me for the 
life I'll lead after I graduate. ^ 

Strongly Strongly 
Disagree Agree 

1 5 % 
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